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I. HISTORY AND INTRODUCTION 


The von Neumann architecture was a brilliant hbpeaee 
through in the development of computers. Through this design 
computing machines achieved an execution speei and power 
which was foreseen Only by men Of, sre2e Vision 
Unfortunately, word-at-a-time processing, which is imoligit 
in this dechivecrine, has become a limiting factor in the 
advancement of machine speed. 

The so-called von Neumann bottleneck can be overcome in 
computer architecture. indeed, there are many acchitectures 
which employ a variety of techniques to circumvent the 
bott lence? by uSing Multiple buses along with multiple 
central processing units (CPUs). For many decaies, commer- 
Cial computers have been structured to handle information 
sequentially. Now, scientists are trying to replace the 
iarge computer, based on sérial instructions, with networks 
of small computers linked in a way that would enable them to 
work on different parts of a proklem concurrently [Ref. 1}. 
Many experts forecast that Japan's fifth generation computer 
systems will nake the Smithsonian Institute the only appro- 
priate place in which to house von Neumann machines. These 
hew computers virtually eliminate von Neumann bottlenecks 
het. 2). 

Not so obvious is the fact that the von Neumann bottle- 
neck has becone manifest not only in computer acchitecture, 
but in the languages which were designed with these machines 
31 pital gyfe t= Since the development of Fortran ia the early 
1950's, high-level programming languages have been based in 
large part on the instruction sets of th2ir "target 
Machines", Fortran was a very efficient languaje, and “age 


achieved that efficiency because its optimizer was developed 


Vie tne lisebueseOn Set Ofth emi biie70 lem the Forefront of 
the designer's mind [Ref. 3: p.33]. Since that time, the 
von Neumann bottleneck has firmly establish2i itself in 
every imperative programaing languaye. The bottleneck is 
manifested in the form of assignment statements [ Ref. 4]. 
We thus find ourselves in a Situation where th2> high-level 
languages we ordinarily use are not capable of taking advan- 
BijTemol tie COMpULIMG power OmmState-of-tnhe-art nachines. it 
seems opvious that computing power which cannot de harnessed 
is not of much value to us. What can we do about that? This 
is the question which provided tne motivation for this 
Enesils. 

Since high-level languages have peen to 4 very great 
extent designed with the instruction sets of their taryet 
macnines in aind, there are limitations built into ithe 
Structure of the languages which will be very i2ifficult to 
overcome. I will spend some time focusing on th2 weaknesses 
of the imperative languages. I would iike to say at the 
outset, however, that I in no way mean to imply that impera- 
tive languages are not extremely useful in many applica- 
tions. The limitations on which I wili primarily focus will 
be in terms of imperative Languages 4S applied t2 concurrent 

Samiiarily, I will | discuss MIMeGt Lond, | Progranning 
languages. I believe that they provide some relief Irom the 
von Neumann bottleneck that cannot be achieved by working 
within the framework of imperative languages. Put another 
way, I believe that functional programming laaguages will 
enable the user to take advantage of the power afforded by 
these new multiprocessor machines in a way that imperative 
languages Simply cannot. Indeed there are technigues which 
can be employed which will extend the "concurrent processing 
power" of imperative lanyuages, but these techniques will 
never manifest all the advantages that functional languages 


afford, such as evaluation order independence. 


A 


There are technicues available which allow for impera- 
tive programs to be translated into Eunctional oles [phetaueo: 
pp. 13651497. I will demonstrate one of these techniques on 
a widely used imperative program: the Shell sort. it should 
be noted, however, that functional programs als> have their 
limitations; but these limitations seem to apply to areas 
other than the concurrent processing issue. 

Aside from the fact that multiprocessor aarcware 1s 
becoming available, there 1S another important reason for 
wanting to develop and exploit the properties of functional 
programming languages whith enhance concurrent processing. 
Researcn conducted for NASA by an independent research f1irn 
fRef. 6] discusses a whole class of problems that are today 
too computationally complex to be accomplished using conven- 
tional computer resources. For example the linear static 
analysis of an undersea oil platform was condicted using 
finite-element structural analysis. The problem had over 
720,000 degr2zes of freeiom, and took about one week of 
processing time on a Univac 1110 computer [| Refee5: pp ouvetaee 
The same authors point out that in tne data-flow machine 
operators "fire" as soon as theic operands ar2 available. 
This is exactly how functional programs work: a functaen 
"fires" as soon as all of itS parameters ar= available! 
Although projrams expressed in seguential ianjuages have 
been successful at expressing parallelism to some degree, 
they do not appear to have the potential of detecting paral- 
lelism of a high degree (100 or more processocs) [Ref. 6: 
Dez ole 

As seems so often to be the case in computer science 
issues, no one technigue will serve as a panacea. Functional 
programming is no exception. Rather, 1t provides the user 
with a great number of advantages, particularly in the area 
of concurrent processing. These must be weiyhed against the 


disadvantages, anda decision can then be made 2ased on the 
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Seeeiicdesdppiucation for whieh the pro@ram 1S intended. I 
hope that this paper will help provide the background for 


that decision-making process. 
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II. IMPERATIVE LANGUAGES: STRENGTHS AND LIMIZATIONS 


A. CONVERSATIONS WITH MACHINES 


Computers , if properly direcrea, have th2 abilitv to 
execute a great many instructiots in a relatively short 
period of time. Yet in ocder to harness this Somputatwomee 
power, one must be abie to communicate with tne computer, 
and give it some “arching jordens =. For quit2 some tine, 
the only way in which to effectively communicate with 
computing machines was to use the macnine‘s native lanyuage 
(cleverly dubbed "machine language!). Indeed, many peocle 
learned to use machine language very well, ani some even 
began to like it!!! To most people, however, talking to a 
Machine was quite a strange concept. Talkinjy using ar 
alphabet consisting of only zeros and ones was Even more 
bizarre! There seemed to be two caaps which developed fron 
this "language problem".  Jne camp lived ror computers. They 
were convinced that the future of the world belonged to 
those whe could "speak" machine Language, ani spared “ae 
effort in becoming friends with their inanimate associates. 
The other camp was at the same time enamored with, skeptical 
of, and intimidated by these new machines. These people 
swore that the slide rule would never be replacei, and that 
the computers were more trouble than they were worth. 

To some extent, both camps were fright. Computers 
certainly do have the the ability to complete tedious, 
boring tasks very quickly and very accurately. Even today, 
however, it seems that it can sometimes be more trouble than 
it 1s worth td get the machine to io what we want. In fact, 
sometimes it seems that we are wocking for the computer, 


instead of the computer serving us as it should be. The 
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development of high-level Languages was undertaken in large 
part to narrow the gap between the two camps descrited 


above. 


Be. ADVANTAGES OF HIGH-LEVEL LANGUAGES 


The fundamental purpose of high-level langiages is to 
provide peopi2 with a more natural way to comnanicate with 
Machines. High-level lanjuages enable people t2 raise their 
Pca thos Mucor ig hchetewel Of abstraction, and to rely 


eiman anecexrpreter OL Compiler to tranSilate th2ir program 


into machine language. When developing 2 high-level 
language, i1t iS important to ask the question, "For whon 
Should the programming language be designed, anyway?" Oz: 


cour se, the answer is that it should serve its (;uMan) user. 
As obvious as that seems, there are still 41 great thanv 
instances when that principle 1s not at the forefront of the 
designer's mind, and the user ends up "working" for the 
machine to some extent. C.A-R. Hoare has never stopped 
preaching the need to keep the human user in mind when 
dealing in programming language design {Ref. 7} [Ref. 8]. 
High-level languages should be kept as simple as possible. 
men extra "Laature" added to a language 1S on more thing 
that the user has to learn. Pie ondeneeoe FUStity the anclu- 
pmoneoL a feitume in a language, the contribution that it 
makes should overwhelmingly outweigh the complexity it adds 
to the language. 

High-level languages bridge the gap betw2en natural 
(human) languages and machine languayes. In the best case, 
therefore, programming languages should be the same as 
Matdral languages. According to Winograd [Ref. 9] the ulti- 
mate programming language would be one in which the 
programmer writes only the comments, and the programming 


environment would take it from there. In other words, the 
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user would be able to use a natural (Spoken) language, ard 
the system would take care of converting tiat to the 


language of the target machine. 


Although this goal seems unachievealtle, it is certainly 
something for which we should strive. We shoula make every 
effort te make programming languages understandable (to the 
human), andat the same time keep error-checking features, 
such as strong typiny, embedded in then. 

High-level programming languages free the usar from some 
of the details oof machine implementation, and hence these 
languages are more powerful and understandable than machine 
languages. Figure 2.1 illustrates a Simple "aid" ins tame. 
ti9h written in four ways: machine languajg2 [kef. 10], 
assembly language [Ref. 10], high-level lanjuage, and 
hatural language. 

Another advantage of high-level languages is that they 
are transportable, i.e., they can be used on more than one 
type (brand/model) Of Nachasme. Compilers and interpreters 
take care of translating them into the instruction set of 
the target machine. Programs written in high-lev2l languages 
are therefor2 eaSier to maintain throughout their life 
cyele. 

Through the years, high-level languages hav2 become nore 
powerful and more understandable. In the next se@zstion I wili 


discuss the evolution of high-level languages. 


C. THE EVOLUTION OF IMPERATIVE LANGOAGES 


With Figure 2.1 in mind,! it's hard to imagine how 
people put up with machine language for so long! As we shall 


see, successive generations of high-level lanjuages have 


1Note that Figure 2.1 is an extremely _sinple example. 
When conditional ox Dre soe aee looping, and recursion are 
introduced the ifferences in complexity among_ the 
different fypes of languages become even more pronounced. 
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Figure 2.1 Language Comparisons for a Simple “Add" 


made programminy much easier, but many feel it is still too 
complex and tedious for the average user to pizsk up. Thus 
the ultimate users of computing power--businessm2n, accoun- 
tants, scientists and engineers--still reguire a middleman 
to communicate with their machines [Ref. 12]. 

As we guickly look at the development of imperative 


programming languages, PS Eeoeskeen Sil mind, th> attributes 
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these languages should have,* some o£ which ac2 tlasted ain 


PiguLe 2-2. 
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Figure 2.2 Desired Attributes of High Level Languages 


People in all walks of life seem to resist cnange. Those 
computer sci2ntists who were "comfortable" with machine 
language embraced the concept of the assembler, Since wie 
made coding easier, and translated directly into machine 
language. This helped the transportapility of tne prograa, 
Since a given program could be run on a different machine 
once it was reassembled. The concept o£ high-lever 
languages, however, waS not so readily accept2d by these 
SClentisSts. 

The principal objection to high-level languajes was that 
they degraded machine erficiency, and hence a significant 
poction of the speed advantage of the comput3r would be 
needlessly ani wastefully lost. FORTRAN was able to gain 
acceptance because it generated code that could usually 
equal, and sdmetimes surpass the efficiency of code gener- 
ated by hand (Ref. 3: pp.33-34j. FORTRAN employ2d sophisti- 


cated optimization technigues. That, coupled with the fact 


“For a more complete discussion on the development of 
attributes in programming languages, see MacLennan's work 
[Ref. 3]... IL am not considering such things as Parnas" prin- 
Ciple of information hiding, “but rather will focus on the 
understandability of the language and the degree to which it 
lends itself to Concurrent pfrocéssing. 
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that it was designed specifically to be implemented on tke 
IBM 704, allowed it to achieve an efficiency jreater than 
Many current-day programming languages. It 13 extrenely 
important to note that the design of the programming 
language followed the design of the machine. This 1S a 
trend which has remained throughout the evolution of impera- 
tive programming languages. It was guite a reasonable depen- 
dency at the time that FOAIRAN was developed, siace computer 
hardware waS much more costly than computer sortware. This 
trend has been reversed [Ref. 28], however, so at least fron 
the viewpoint of cost, we are now free to develdp languages 
Taewowt Specifiewhardware configurations. in mind...and tunen 
deveiop the hardware based on the software reguirements. 
FORTRAN had a tremendous impact on tne conpiter science 
Piaustry. Ie certainly freed the user from t2any mundane 
tasks, and enabled him/her to work at a higher level of 
abstraction. However after the "honeymoon" of FOnTRAN was 
over; wayS in which it could be improved began to surface. 
ie 76S,.DigksStra stated tEnat he was convinced that the go 
to should abolished from high-level languages [R2f. 14]. He 
felt that the go to statement was an invitatio1 to make 4a 
mess of one'S program, Since it was so unstructured. 
ALGOL-60 had many features which potentially made programs 
much easier to understand, and hence easier to maintain. 
Indeed, Wult [Ref. 15] developed a systematic way to elimi- 
Wee OC tos [rom a program, by introducing B2so0lean vari- 
ables. Wulf was among many who seemed to feel that 
efficiency should not be maximized at the expense of under- 
Standability of a pregram. There seamed to be a strong (and 
in my view healthy) trend toward developing languages that 
were "user friendly." This trend continued with the design 
of Pascal, which was developed as a "teaching laaguage". [It 
also encorporated strong typing and parameter passing safe- 
guards in order to protect the user from program side 


effects. 
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Shortly after Pascal was developed, Wulf and Shaw 
declared that global variables were also harmful [Ref. 16]. 
He pointed out that they also lead to side effests, and were 
really a result of sloppy (and lazy) programming. 

Throughout the development of imperative programming 
languages, a strong effort was made td have them serve their 
(human) users by making them easier to Learn and to under- 
stand. At the same time, very large scale integration (VLS7Z) 
circuits were Fbeing developed, which was making computer 
hardware both more efficient and less expensive. This vas 
part of the reason why machine erficiency couli te sacri- 
ficed for the sake of language clarity. John Batkus {isomer 
cally, the man behind the design of FORTRAN) pointed out in 
1978 [Ref. 4] that imperative languages were slaves to the 
word-at-a-time architecture on which they were originally 
developed. He tagged one more construct as being harmful: 


the assignment statement! 


D. THE VON NEUMANN BOTTLENECK OF PROGRAMMING LANGUAGES 


Although the von Neumann architecture was a brilliant 
breakthrough in the development of computer systems, its 
function reiies on the transfer of information between 
memory and the central processing unit along a bus. Inherent 
in this architecture is the fact that information f2owsee 
limited to on2 word at a time. Unfortunately, this limita- 
tion (known as the von Neumann bottleneck) has put an upper 
bound on the potential speed of conventional computers. 

Remember that one of the reasons that FORIRAN was so 
efficient was that the designers of its optimizer used the 
instruction set of the target machine as the frane of refer- 
ence from which they worked. AS successive geaerations of 
languages were developed, designers depended less and less 


om the architecture of the target machine(s). Jowever, in 
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most cases, languages were still developed using the von 
Pacem points Out [Rel sae SS sorogramming laaguages “use 
variables to imitate the computer's storage cells. Control 
Statements elaborate its jump and test instructions, and 
aSSignment statements imitate its fetching, Sc Ormng. and 
Beat hmetic. The assignment statement is the von Neumann 
bottleneck of programming languages ani keeps us thinking in 
word-at-a-time terms in much the same way the computer's 
bottleneck does." 

Backus go@s on to describe how imperative laiguages have 
eer led £he ~sreativity of computer architects, Since fany 
‘architects ar2 ina way held prisoner by the von Neumann 
mindset. Moreover, even languageS which have attempted to 
avoid the imperative features (such as _ LISP) have been 
engulfed in von Neumann features.3 It would seen that there 
iS a vicious tircle between the architecture bottleneck and 
the language bottleneck. If so, then why arentt imperative 
languages good enough? 

The reason is that many computer architects have aban- 
doned the von Neumann conztepts in their designs, and are 
coming up with designs which can potentially process infor- 
mation much faster than conventional machines. Lerner points 
out that the advent of VLSI technology has made the develop- 
ment of highly parallel computers a practical possibility 
mers 17 |. He says, “Of the various competing ideas of how 
a parallel computer can be built, the best known and most 
developed is called data-flow. In data-flow computers, each 
of many identical processors calculates results as the data 


for a given computation becomes available." 


JLISP has features such as "PROS" and "SETQ)" which are 
really forms of the assignment statement. In Chapter IV I 
eee example of a LISP program which illustrates this 
point. 
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The groundwork has been laid for concurrent processing. 
In order to utilize the potential of parallel processome, 
the bottleneck of programming languages must be eliminated, 


or at least reduced. This has been a topic of sonsiderable 


discusSion,* particularly in operating systems, where the 
concept yot, "processes! Pros lscca. There are at least tnree 
difficulties encounterei with thes concurred process 
concept: commuiniecatiow SYNCHEORIZaAtIOn,; and non - 


determinancy. There 18 an excellent dj1iScussion of thesew@=byv 
Bryant and Dennis, usiny the airline schedulinj problem as 
an example [Ref. 19]. Dijkstra describes a system or "coop- 
erating" sequential processes in whicn he uses two Scema- 
phores, ee Operation" and WY SeOoucra tion, to permit 
concurrency and eliminate side effects [Ref. 18]. There are 
difficulties posed by this sSyereuq the processes must be 
cooperating, and there exists danger of a "deaily embrace" 
(deadlock). 

Hoare describes a system of monitors which assumes (as 
in the case of semaphores) that all processes have access to 
a Single Shared memory {Ref. 20}. Both Semaphoces and @iona 
tors provide a2 means to suspend the execution of processes 
until certain conditions are satisfied. Problems of deadlock 
remain an issue. Actor Ssenantics 1S another way »f enhancin 
parallel processing through message passing [{Ref. 21}. 

All of these methods are attempts to extend the power of 
imperative languages. They try to circumvent the limitations 
of the assigoment statement, rather than dealing with it 
directly. In order to fully utilize the conputatd#eneee 
processing power of parailel machines, parallelism must be 


built into the languages themselves. 


*Concurrent processing is. not. a new conce 
becomes even more important in view of the b 


ot, Dut. ae 
4 e « C a 
tnat are being made in computer architecture. 


eakthroughs 
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An extension to Pascal was established witi just this 
purpose in mind. Essentially, semaphores were made avail- 
able for Pascal, which allowed the projrammer to take advan- 
mIge Gf  Conmecirrency. Pascal has now built-in support for 
concurrency. It is the responsibility of the programmer to 
menmtainy Critacal sections> and to "protect then" with P ani 
VY operations. 

iced tkismibey vith utilizing the above method to write 
Concurrent program sections is that it forces the progrannzer 
to think at too detailed a level. That makes the chance of 
creating an error (and perhaps one which will b2 manireste? 
Smly In Subtie but important side effests) all too great. 

There are two main issues in programming lanjyuages wnuicr 
support concurrent processing [Ref. 19]. Phew elias 1S etd ¢ 
the expressive power of tne language should b2 maximized. 
The second is that programs should pe clear and understand- 
able. The latter is especially important in concurrent 
programaing languages. 

Ada is another exampl2 of an imperative laaguage which 
attempts to make concurrency more attainable. [Its designers 
seem to recognize that the assignment statement is directly 
related to the concurrent processing limitations of impera- 
tive languages. Booch suggests that therein lies the 
strength of Aja: a program designer can take a declarative 
view of the solution, not the imperative one that many other 
janguages forse them into [Ref. 22]. Diem Sdsic Coustruct 
for concurrent processes in Ada is the task. A task is like 
a package, but instead of types, constants, variables, 
procedures, and functions, a task exports only task entries. 


Task entries correspond most closely to procedures with in, 


SA critical section 1s a piece of VEO een belonging toa 
class of program sections of which only One can be exécuted 


at a time. iMimounere, WwotLdS Critical sections are inter- 
Perendemts “ites G6den for program sections to Cun concur- 
rently, they need to have mutually exclusive access to 


critical sections they reference [Ref. 25]. 


De. 


out, or in-out parameters. The implementation »f a task is 
hidden from tne user in the Same manner aS a package body. 
Task bodies describe the necessary synchronization of the 
implemented entries [Ref. 23]. 

The task concept does enhance concurrent processing at 
the course-grained level. Ada also encourages nodulariza- 
tion, which from a design “peinteomete., ens>ourages the 
development of components which lend themselves to concur- 
rent processing, 1.e. are independent of one another. Also, 
the task is a buiit in feature of the lanjuage which 
directly supports concurrent processing. 

In my view, however, Ada does not go far enough. When 
Dijkstra and others identified the jo to as Shawarma 
[Ref. 14], the solution was not to reduce the aumber cf go 
tos, but to eliminate them through structured 2rogramming. 
Similarly, programmers could be forced to a higher level of 
abstraction through a functional programming language (FPL) 

In my opinion, the best way to eliminate assignment 
statements and to maximize concurrent processinj is through 
evaiuation ocder indepen dence. Pane oo jane programming 
languages exhibit this property. In the next chapter I will 
discuss evaluation order independence and funct lomal 


programming languages in more detail. 
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Ae. AN OVERVIEW OF FUNCTIONAL PROGRAMMING LANGUAGES 


RicurunecreOtamPELOTEaANTIng. tO Whiten i have been refer- 
Pepe is Khown by a Variety ~oE names, such as applicative 
programming and value-oriented programming. It 1S a method 
of programming which ditfers from imperative programming in 
Several important ways. As I nave nentioned in previous 
chapters, imperative languages depend heavily oa the assignr- 
ment statement for accomplishing their tasks. MacLennan 
points out that most imperative programming languages are 
misically collections of mechanisms Cor routing control fron 
oue assignment statement to another. Ina functional appli- 
maeron, the Central 1dea 1S te apply a Eunction to its arsu- 
ments [{Ref. 3: pp.344-345]}. This can be done ina variety 
of notations (discussed later) but is commonly 2xpressed it. 
Cambridge Polish. Cambridge Polish is also called prefix 
notation because the operator 1S written befor2 the oper- 
as. ® Functional notation guite naturally allows the 
programmer to raise himself to higher Levels of abstraction. 
This is because functions can be applied to functions. (See 
Figure [3.8] for an example.) Functional programs also use 
"layering" to free the programmer from details. For example, 
in order to update an array, the programmer sould simply 
Sele the Lwnoction update f[Ref. 24] (Figure 3.1). Such a 
function replaces the ith element of array A with x. The 
programmer need not concern himself with cons, c2st, oor the 
recursive nature of the function. He is ablé to concentrate 


Pew Dulldirg programs rather than concentrating on the 


6As a Simple example, the infix. algebrais expression 
ee) would be written as plus(a,b) ide preri kk funet 10ka lL 
notation. 
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Figure 3.1 Functions Applied to Functions 
objects which make uf the program { Ref. 11}. This leads £5 


programs which are more understandable, and henzte easier to 
Maintain. There 1S a cost involved tnough: program effi- 
ciency. Hend2rson estimates that functional crograms nay be 
as much as ten times less efficient than machile Lanyuage’ 
(Rei seoulls 

To thoroughly discuss the development of a functional 


programming language 1S beyond tne scope of this paper. 


Rather I will give a few sSimpie examples. In the next 
chapter I will give examples £ functional prcrd grams whee 
acre a bit more complicated. A more detailed explanation of 


the semantics of functional progranming can be found in 
textbooks by Henderson [Ref. 5] or Burge [ Ref. 26], or in 
NacLentan's soon-to-be published Jtexc [Reto e2 4a As I 
mentioned earlier, LISP has many functional features. 
Therefore, an understanding of functional progranaming seman- 
tics could also be achieved by studying LISP, although one 
would have to be careful to "filter out" th2 imperative 


features that it contains. 


7 nec tape an loss 1s due not only to cdmpilem usey 
but also to the fact that functional programs generally have 
Many more procedure calls than do imperative projrams. Note 
that efficienty loss here assumes the use of a ufiprocessor. 
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MacLennan discusses two "worlds" within programming 
languages: the world of statements and the worli of expres- 
sions [Ref. 24]. In the world of statements, the order in 
which things are evaluated is critical. A sSimpl2> example of 
mies 2S listed ain Figure 3. 2. 

When assignment statements are present, it is guite 
possible that different sactions of code witnin the same 


program will be inter-dependent. Such inter-cepaidencies can 
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Figure 3.2 Evaluation Order is Important with Statements 


be avoided by using pure expressions. A pure 2xpression is 
one Which contains no assignment Statements, either directly 
or indirectly. An example of an indirect assigament state- 
ment would be an expression which contains an assignment 
Statement hidden in a function, such as in Figuc2 3.3. 
Arithmetic expressions are good examples of pure 
expressions. [In pure expressions, the operators ire "memory- 
less", that is, the expression always has tne same value 


Within a given context. For example, in a context in which 
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; OO EE Eee 
aH + f£(w) | 
where : 
a3, ez, Fs | 
y= w= = >k:= 
aes ; 1X3 BK | 

A 

= 
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Figure 3.3 Assignment Statement Hidden in a Function 


a=2, at3 will always be 5. Moreover, the evaluation of any 
SubexpresSion will have no effect on the evaluation of anv 
other subexpression. Figure 3.4 presents a pure expression 


in tree) Lorie 


i ae 
| “ ty 
| 


| 
| 
| 
| 
| 
| 
times{plus(A,B), minus(C,D) } | 
| 
J 


Figure 3.4 A Pure Expression 


Notice that not only can the subexpressions be eval- 
uated in any order, but (assuming the availability of more 
than one processor) they can be evaluated sinultaneously! 
This is one of the big advantages that pure expressions 
offer parallel processors. This property of o2ure expres- 
Sions, independence of evaluation order, 1s called the 


Church-Rosser property [{Ref. 26}. It allows compilers to 


choose the evaluation order that will make the best use of 


Machine resources [Ref. 24]. 


2.3 | 


The ss Svameation of the expression starts at the 


leaves of the tree. fThe plus operator can be applied to "A" 


and "B" as soon as they have values. Hii ly, che minus 
Seetator Can GOemapplied to "GG" and "D'eas soon as they have 
values. The times operator can be applied to the "-" and "+" 


nodes aS soon as they have values associated with them. [In 
more complicated expressions, we can envision values "perco- 
dating up" the tree in many different subexpressions. If the 
computer had many processocs, then the computation of many 
subexpressions could be performed at the Same tine. 

The properties of pure expressions are Sammarizedi ir 
Figure 3.5. Many of these properties are ideally suitec ‘for 
Meagbams that are to be run on a multi-rocessor, Such as a 


data~flow computer. I will elaborate on some of then. 


| 
value is independent of the evaluation ordec 
referential transparency | 
no side 2frects | 
anputs t> anh operation are obvious fron 
the written foro | 
SErceLects Of afi operation are obvious £Erom 
the written form : 
| 
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Figure 3.5 Properties of Pure Expressions 


As I mentioned above, independence of evaluation 
order is an extremely important property when it comes to 
concurrent processing. Recall that some imperative languages 
have mechanisas for evaluating different program segments in 
parallel, but that the burden is on the programner to iden- 
mey the critical sections. mis tS ner at all Satisfac- 
tory, because it makes the concurrent processing mechanism 
quite subject to programming error. Moreover, the errors 


which are made are not likely to be at all obviois. Rather, 
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they will be nanifested im side effects, some of which Malgm7 
well escape detection even under rigorous testing of the 
program. In pure expressions, we are guaranteed that subex- 
pressions can be evaluated concurrently. There ifre nowenaaee 
ical sections, 1.e. there 1s no interdependence among 
subexpressions! This frees the programmer from tae burden of 
identifying the critical sections, and places the concu@— 
rency mechanism exactly where it belongs: inside the 
language itself. 

The property of ceferential {fFanspacoicy ea 
which has the potential to greatly improve program effi- 
ciency. It says that a Jjiven expression (ot sud expression) 
Wwili always evaluate to the sane value within a given 
context. Hence if a given expression is used several times 
in the same context, it need be evaluated only once! The 
value of the expression could be placed in a register, ina 
look=up tablegeet=. Of course, the compiler would also have 
the option cf reevaluating the expression, i1f that turned 


out to be more efficient. 


Ze Pure Functions 


Functions are mathematical mappings fron inputs to 
outputs. This means that the result depends only on the 
inputs. If the functions are made up of pure expressions, 
i.e., they contain no explicit or hidden assignment state- 
ments, then the functions will retain all the pcoperties of 
pure expressions. This is the basis of functional progran- 
ming. Functions are applied to functions td raise the 
programmer to higher and higher levels of abstraction, and 
thus free him from as many implementation details as 
possible. Tke tasis for this is pure expressions, which in 


turn are used to build purestunetivons- 


Zo 


In addiition to the properties of pure 2xpresSiors, 
functional programs have some attributes which make tnenm 
superior to conventional languages. Figure 3.6 lists some of 


these attributes. 
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Figure 3.6 Properties of Fuactional Projrams 


The basis for most functional programning languages, 
moeluding the one that I will use in my examples, 1s Similar 
Poethat used in LISP. (heeeinietioms siltrSt, crest, apvend, 


reverse, sub, null, ard cons are used aS an integral part of 
the language. If you are not familiar with thes2> functions, 
Meet er you to chapter two of reference [2/7], or to chapter 
hine of reference [3]. 

There are many notations usei in functioaal progran- 
Ming. Aithough some people will claim that one notation is 
eee, readabse than another, and others Claim just the oppo- 
Site, I believe that there is not really much difference 
among the notations. This, like many preferences, seems to 


be due to the system with which you have become nost 


mami liar. A similar situation e2xists in calculator use, 
where some people prefer a Hewlett-Packard calculator 
because it uses postfix notation, and others prefer to use 


Texas Instruments calculators because they use infix nota- 


tion. The differences ar2 more a matter of focm than they 


are of substance. Similarly variations among notations in 
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functional programming languages really come down to 
syntactic sugar, and not to the expressive power of tke 
notations. I have chosen the notation in this paper asa 
matter of typographical convenience. 

In functional programming there is only one Due 


in-operation: the application of a Eunction to i1tS)ameee 


ment(s) [Ref 24}. As I pointed out earlier, plus (a,b) 
would apply the "plus" function to the argum=atS ‘da Same 
UO ge ae 


Conditionals are 4 very natucal and important pane 
or functional programming. For example, if we want ~ToONd@erae 
a function which returns the length of a list, «€ Garnwaeueee 


aS in Figure 327. 


ELT EE TT 
i length L= _ . { 
if nuliyL--=—> 90 | 
else length(rest L) + 1 | 
—s | 
| 
ee ee SSS 

Figure 3.7 Conditionals in Functional Definitions 


Note that the definition of length is recursive, 
that is, it is a function which Salis itseli gs eee 
extremely comnon in functional programming, since to detine 
functions explicitly (by enumeration of all input-ougoee 
pairs) 1S Not Very jpEacctearms. 

The practice of defining functions in the fashatenm 
used in Figure 3.7 often makes the proort of cocrectness of 
functional programs much more straight forward than the 
proof of imperative programs. Quite often recursive func- 


tions can be proved correct bY induction. Suche sauerooemen 
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induction can proceed fErom the functions of innermost 
nesting, to the outermost nesting.& 

I have mentioned Elivelie @ "pe tuelond ator ot. ail programming 
languageS permit the user to work ata anigh2r level of 
abstraction. For example, the map function, applies a one- 
argument function to every element of a list. for example, 
if L isa list of numbers representing angles, fap sin 
computes the sines of the corresponding angles. Figure 3.8 


is the definition of map sin. 
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gt 0) Bd We Oe ola 
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Figure 3:58 Mapping Across a List 


Functional prograns also lend themselv2s to alge- 


Peale Manipulation. Forse emp bce nO be 1h = Figuregg.9 that 
functions often are commutative. Backus gives an excelient 
presentation of the algebra SEweLUnctional progrdiiming 


languages [Ref. 4]. 
Functional programs seem very natural to people with 
a background in mathematics. The concepts of zsomposition, 


reduction, transposition, identity, etc. are intuitive to 


these people. They can frequently learn a great deal about 
miienkiOnd! proguamming in a short period of tine. On the 
other hand, the notations of PUneculehal — PEGjranMing 


lanyuages are often “such that they abe “not intimidatingsto 
people without a strong background in mathematics. Although 


most functional programming is based on the work of the 


mance Lonswould be 


So ieene gests Be ary ae st t 
Eumetion would be 


proved corre=t 
proved. 


lannda calculus, if, doses not adopt its intima deauaag 


symbology. 


: cest(map sin L) = map sSin(rest L) | 
Em 


Figure 3.9 Algebraic Properties of FPLs 


Functional programming languages are less likely to 
"throw away" information that the programmer has than ame 
conventional programming languages. For example, Su>eG@ee 
that a progranmer wantS td map the product reduction across 
a list of lists. He knows what he wants to do; he wants to 
use a cereral function which will take inputs of themgom, 

<<2,3>, K1,4, eco, 
and produce a list like? | 
<times (293), times(tines (1,4) ,6) 7a, 1,5 tines oe 
which evaluates to 
<6, 2%, 37° \eer2 

Figure 3.10 shows the definition of such a function, called 
Map prod. iIn such a systen, the individual product reduc- 
tions or all the lists could be performed simultaneously. 
The programmer knows that, and indeed that can occur Mie 
uses a functional programming language. However, 1f£ he 
writes his program ina conventional languag2, Suche 
FORTRAN, he will be forced to write it using “Do loopem 
Even though ha knows that the operations can be serformed in 
parallel, that information is "hidden" from the machine. 


Thus Operations which could be safely conductei in parallel 


9Actually, each element in the list eee a<>") would 
call the function times once more, in the Form times (x,1) 
where x = the element oF the list. 


oS).5) 


| 

| prod L = 
hull Lo===—> 1 | 

else times[ (first L), | 

| prod (rest L) ] | 
| 

Mar prod L = 

| EL null L ---> nil 
| 


SLoe.cOLsmyohOdielr Sto), 
rest L) j 


| Map prod({ 
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Figure 3.1) Product Reduction Across a List of Lists 


Be. FUNCTIONAL PROGRAMS ON UNIPROCESSORS 


Functional programming languages (and in pacticular the 
lambda calculus) were in 2xistence long before the need for 
concurrent processing became apparent. AS I distissed ir th 
first chapter, programming languages should serve their 
(human) users. A large part of that goal can be achieved by 
Making the language understandable to people! Henderson 
states that the willingness to accept less efficient but 
more understandable programs is a trend which will accel- 
erate in the near future [Ref. 5]. One wiy to make 
danguages more understandable is to make them simpler and 
more uniform. Functional programming languages, with their 
one built-in operation, are certainly that! Because the 
programmer can work at a higher level of abstraction with 
functional programming lanjuages, the programs he writes can 
be shorter and clearer. Since software costs ov2rwhelmingly 
dominate hardware costs [Ref. 28], and since the maintenance 


phase (including program improvement/enhancement) is the 
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longest phase of a program's life cyele, we can Jaina Gea 
deal by using a programming language that is easy for people 
to understand. A carefully written fincotional program* ? ae 
usually be much more readable than one written in a conven- 
tional language. That alone makes functional prdgramming an 
attractive option. 

Exhaustive testing of anything but a trivial program is 
not usually practical. Even when a program is sub j)e€G@ peau 
extenSive testing, "bugs" frequently are presanot in early 
versions. There are many Situations, such aS military aprli- 
cations involving nuclear weapons, when even avery Low 
probability of program error 1S unacceptable. In Suga eae 
ations, we would like to prove the program correct before it 
is used. Functional prograaming lends itself to forral nath- 
ematical proofs. That is not to say that proofs of Comoe 
cated programs are easily accomplished, even 1£ the progran 
iS written ina fEunctional langue. However, proof of 
correctness 1s much more achieveable if the program is 


WElTtEN ina fei 


C. FUNCTIONAL PROGRAMMING ON A MULTIPROCESSOR 


One of the tradeoffs w2 deal with when usinj functional 
programs on a unhiprocessof 1S program Clarity ¢s. progam 
efficiency. The property of referential transpacency always 
applies to functional programs. Therefore, even on a 
unlprocessor, there is acertain amount of efficiency 
gained. However, this will be offset many times over by the 
increased number of procedure calls in a functioial progran. 


SO ona uniprocessor, the user gives up efficiency for 


10Later 1a the paper I will give 4a comparison between a 

ee ram written "mechanically" and am elegant Solutions 

ifferences are not always great- In any €ase, a4 Goodytines 

tional progranmer should be able to easily rewrite mechani- 

Gal iy transformed programs so that tney wae. quite 
understandakle. 
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understandability. In other words, Mewes ass eptal le. for 
understandable programs to take longer to run. 

On a multiprocessor such as a data~flow macaine, effi- 
ciency must be viewed in a different light. Sinc2> the systen 
has hundreds or even thousands of processors available for 
use at one time, any given program can take advantage of 
that only if different program parts can be run sinmultane- 
ously on different processors. ID ranctiona. programs, the 
inerficiency caused by the procedure calis is more than 
offset by the number of processors working on the progran at 
any one time. Thus the independence of evaliation order 
Mmeayeed CLUClal part in the turnaround time of 4a prograa on 
a muitiprocessor. 

Cima toc-scee SUCh aS a data—-tlow machine, 2 functional 


a ee Se 


poe NOne a fricleve 
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bhi more uhierstandable 


2 1 
PhemwiGlh tne Getta COnVe nt Okabe Language’. 


De. UNDEZRSTANDABILITY OF FUNCTIONAL PROGRAMS 


Cie wo, ere phic pal Aa@vantages Of T=zuncttoral progran- 
Ming languages is that they allow the programmer to work at 
a higher level of abstraction, and thus free him from many 
implementation details. This 1S accomplished tkrough the 
meavering” principle. Functions are defined using previously 
Meeined functitons. In thiS Way, the Drimitive Functions o£ 
the language, although they are implicitly included in every 
program, need not appear explicitly anywhere in the code. 

A simple example of this layering principle is found in 
an exercise in Henderson's book [Ref. 5: p.280]. First we 
define a function which takes as argument a pair of numbers 
and returns as result theic minimum and their maximum. MThis 
is done in Figure 3.11. Next we define a function which 
takeS aS argument three numbers and returns three results, 
the numbers in ascending order. [This 1s shown in Figure 
Berl 2. 
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As you can see, it is easy for the progranmer Comma 
the sort function from a higher levee sas. 
1. Ocder the first two elements. 
2. Order the second two elements. 
3. Order the first two elements. 


When the programmer is writing (or reviewinj) the sor 
a 


function, he doesn't have to be concerned with the details 


of how the order function works. That was doaie when the 


Sapa a — 


order function was written. Of Course, this sine thimemean 


be done when working with an imperative languag3, but “eee 


the very essence of functional projramming. 


= ON eee 1 

| ClLeern (x  m = | 
Lf xX Soy. then | 

| <x, ¥2 
else 

| <y,X> | 

| —_an ee eS r 


Figure 3.11 The Ordering of Two Numbers 


; OT Ea eee 
| SOLFte (a, 0,c) = | 
flet <a h>' = 0.b dems asain | 

i flet <b ,0> = order (6, c) { 
| {let <a,b> = order (a,b) | 
| <a Cot} 
sek ! 


Figuce 3.12 The Sorting of Three Numbers 


Even functional programs are not always easy for people 
to read and understand. This can be because th2 program is 
Not Written careful or because the program is terribly 


complex even when written in a functional languajye. However, 


ou 


even when functional programs are complicated, they still 
retain the properties of pure expressions. Taney will be 
easier to errove than imperative programs, ani will still 


lend themselves quite nicely to concurrent processing. 


In order for a programmer to develop functional 
programs which are as efficient and as unaerstandable as 
posSsibie, the problem must be stripped down to its bare 
bones, and developed from the outset with a functional 
approach. This will ke a time consuming process, since it 
will involve the same kinas of steps as does the development 
OL -:an imperative program. The functional program will have 
tne advantage that its developers wiil be able to work ata 
meee e level of abstraction, but itewill still take consid- 
eradDle effort to develop the progran. 

The resulting program should be one which will be 
extremely easy to read, and which will have all the advan- 
tages that we need in order to bax Lnize | CONncCurrLrent 
Meocessing. Ih COmparlson tO an imperative projran, it will 
be easier for people to understand, easier to prove correct, 
and will remove the burien of identifying the critical 
sections from the programner. Keep in mind, however, that 
the development cost of this program will be of the same 
order of magnitude as the development cost of an imperative 


program to do the same job. 


2. Mechanical Transfoc mations 





Let's suppose that we already have an imperative 
program for a certain application, and that we ace satisfied 
with its performance from every aspect except one: speed of 
execution. Or suppose that we are considering buying a data- 
flow machine, but we don't want to "throw away" all the 


existing software which 1S written in an imperative 
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language. Of course, we can develop "elegant" functional 
programs, but that really comes doway to™ throwing away ae 
oli software, which is something we were trying to avoid. 
Henderson has developed a mechanical method which takes an 
imperative program and transforms it into a functional one 
fRef. 5: pp. 136-149]. The result i5 a program that haawuee 
the properties of a functional program, except that it Spee 
not be as easy to understand as the "elegant" solution. 
However, the develorment costs of mechanical transformation 
are nominal. i present this mechanical transformarion 
process in the next chapter. The approach that it takes is 
very much like the approach that Wulf and Shaw toox 
(Ref. 16] when they mechanically removed S2) fos iron 
programs. Henderson's metnod is an excellent and inexpensive 
way to transform programs which will not regquir2 much main- 
tenance, i.e. programs which have been time tested and which 
perform satisfactorily. They are also very readable, and 
hence easy to maintain, although pernaps not to the extent 


of the "elegant" solution. 


Ee ALTERNATIVES TO FUNCTIONAL PROGRAMMING 


There are certainly many applications for wiich impera- 
tive programs will perform quite nicely. Moreovec, there are 
some applications for which functional programs are not 
particularly well suited. Recall that the operators in func- 
tional programming languages are "memoryless", This means 
that functional programming languages are ill-suited for 
applications which must focus on state changes. Another 
argument that could be made against functional programming 
languages is that they are not common in industry. This is 
true, and is probably the very reason that COBOL and FOETRAN 
are still so prevalent. I do not intend to dwell on people's 


resistance to change, nor on the management considerations 
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of how to effectively implemert change. I intend merely to 
present a reasonable argument for change, and leave the 
decision to the reader. 

There may be cases where it would be easi2r and more 
cost effective for a firm to extend theic concurrent 
Beocessing Capability through a language like concurrent 
Pascal. No doubt, suck a plan would have a great deal of 
merit, eSpecially when considering the costs that could be 
SaveGd 1h programmer training. However, if such a plan were 
adopted, the responsibility to identify critical sections 
(which could lead toa whole realm of potential errors) 
wouid be placed on the shoulders of the programmer, insteac 
or on the language itself, where it belonys. There might be 
Pmieors Of OmMisSi0n, Which would result in idle [2U time, ani 
PEEOrsS OL COMM1ISSiOL, VWitGmmwoule LteSult ins) ,otential run 
time e€Lrors. 

Finally, I must point out that there are otn2r "Special" 
languages, such as VAL (Ref. 29]. VAL was develovded at 
tla ae Specrmicalily coe the purpose of CONCULZent 
procesSing. The designers have cleverly kept the assiygnaent 
Statement (":=") in the language, presumably so that experi- 
enced programmers would feel "at home" when they began to 
Study it. But, the ";=" does not have the meaning of the 
assignment statement at all! Just as in functional progran- 
ming languages, VAL uses variable free programming. McGraw 
rerers to a Single-assignment rule, which means that once an 
identifier is bound to a value, that binding remains in 
force for the entire scope of access to that identifier 
eer. 29: p51]. This is how VAL achieves the property oé 
evaluation orier independence, and in turn why it is so well 
Suited for concurrent processing. In my opinion, VAL is 
really just another another member of the functional 
programming language family. Its differences ar2 slight and 


are mostly a matter of notation. 


4Q 


In the next chapter I will describe Henderson's trans- 
formation process, and extend it to handle arrays and 


records. 
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A. FROM IMPERATIVE TO FUNCTIONAL 


In this chapter I would like to suppose tiat we have 
already decided to take advantage of the processing power 
aictorded by a multiprocessor architecture. In order to do 
this, we will have to employ a programming language that 
does not use assignment statements. FOr Proghaas Which are 
being developed for the first time, we will use the func- 
meonds approach  Erom the outset. But what about existing 
PextwWare that iS written 1m an inperative langiage? AS I 
pointed out in the previous chapter, we couli develop hew 
functional programs. The problem with this methol is that it 
in no way takes advantage of the investment we nade when the 
software was originally developed. 

Henderson describes a aechanical way to transform imper- 
mauve  DELOGLaNSwanto funcezonal programs { Ref. 5]. This 
method has the advantage that the programs which it produces 
contain all the properties of pure expressions, including 
muaependence of evaluation order and referential transpar- 
ency. For cases in which we are satisfied with the perfora- 
ance of an imperative program already in our inventory, andi 
if these programs are not subject to a great deal of change 
Or maintenance, we couid think of these aS programs in an 
imperative "black box Figure 4.1 illustrates how 
Henderson's m2thod could be used to transform these programs 
maeo DLOGraAnNS 8imea, functional “black box". Tae resulting 
programs have all the characteristics of the original 
programs with respect to program correctness. omy ci, 
redundant assignment statements in the imperative program 


will be eliminated by the transformation process. Therefore 
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if we were satisfied with the performance of th2 programs in 
imperative forn, we are guaranteed to be satisfied with 
their performance in functional form. The performance of 
the functional programs will be tne same as th2 imperative 
programs, except that the functional programs can be 


processed op a parallel processor. 
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Figure 4.1 Program Transformation 


In the next section, I will present th2 basicsiag. 
Henderson's transformation process. As my basis I will use 
an imperative program which takes as input two positive 
integers, and which outputs the lesser of the two. I use 
this trivial program not for its application valie, butWomme 
to demonstrate the transformation process. I will ignore 
the input/foutput mechanisms in the programs for now, but 
will comment on them in general in my concluSion. Figure 


4.2 shows the imperative version of the progran. 


Be HENDERSON'S TRANSFORMATION PROCESS 


The first step in Henderson's transformatioi process is 
to make a flow chart from the existing imperative program.!1! 


The flow chart for the imperative program is in Figure 4.3, 


J 117—n present ay computer science circles the use of 
flow charts to _develop PEO?G fans > hot encouraged: 
Nevertheless 1t 1S a very useful tool here jist 4S it Gime 
in Wulf and Shaw's method Of eliminating Go tos: 
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| 
procedure lesser(x,y,: integer); | 
Ui wit diteeeta CO ge EF 5 | 
begin j 
ie (ony aecive } | 
Maan: = xs | 
else 
| Minse> Ys. | 
eee be. a | 
| end; (*procedure m1n*) | 
| 
a J 
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Pigure 4.2 An Imperative Progran 


The numbers on the edges of the flow chart correspond to the 
Steps of the transformation process as I derive the corre- 
Peeomarig tunceaonal  pErogram. Nots that local variables in 
the imperative program are eliminated in the ‘functional 
progran. 

The general procedure in the transformation process is 
to begin at the exit of the program (or procejlure) and to 
work backwards to the beyinning. The exit is usially repre- 


sented by the identity function.12 In this cas? it is the 


Variakle min. 


step i. 


At (1) mia is output: 


{min} 


When crossing a block which is an assignment statement, 
that which is on the right side of the aSsignment statement 
is substituted for all instances of the variable on the left 
side of the assignment statement which are fdund in the 
parameter list. Thus it is through parameter passing that 


assignment statements are handled in functional programs. 


L2Throughosut this chapter, I will use ne braces'! 
to identify sections of program which have changed in 
any Given step. 
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Figure 4.3 Flowchart of "lesser" 


{x } 
step 3. 
At (3) y is substituted for all instances of min: 
{y } 
When crossing a decision block, the condibilon Of Ste 


block is included in the code so that the program will 
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beanch tO One Of Wwom previouslyedeveloped steps". No new 


eipestitutions are made. 


Beep 4. At (4) the program branches t5 either (2) or (3): 
ite ct NCD} 
x 
felse} 
a 


When you have worked your way to the beginzing of tne 
Mmeowecidit, the guUnction is defined. Figure 4.4 sontains the 


functional definition of lesser. 


a Se a ee ce ee mee ee ce se ci em ee a ie Sa 


lesser (x, 
gy oh Xx < y then 


pp Oy eee] 


| 
_ 


eae 


Figure 4.4 A Functional Progran 


C. EXTENDING THE BASIC PROCESS 


In prograns which have loops in them, we nuSt have a 
mechanism which "cuts" tha Loop, or else the program would 
never terminate. This is done by giving each loop a function 
name. The flow chart is labeled with the name at the entry 
point. At the conclusion of the transformation process, the 
definitions of all the "sub-functions" will be found at the 
point on the chart where they are identified. For example, 
let's convert an imperative prograa which doubles a positive 


integer to its highest two digit number.13 [If the input 


23Just as in the last example, the program [— use is not 
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value is strictly greater than 30jeif is returnel aS ieee 
example, highest (2) = 64, highest(3) = 96, highest(5) = 60) 
hignest (150) = 150, highest (43) = 43, etc. Figure 4.5 


contains the imperative progran. 


—----—-----------—--—- 


pt ogeduac highest (Varee integer. 
egin 
it <a> 20 en 
writeln (x) 


while Bee < 50 do 
ae 
eriteit{xy 
Senda a a 2% 30 
end (sprocwiens cents 


9) 
Wy) 
0) 


— —* 
| 
! 


: 
| 
| 
. 
| 
| 
| 
| 


Figure 4.5 An Imperative Program with Looping 


A flow chart is developed for tne program (Figure 4.6). 
As usual, the numbers on the flow chart correspond to the 


steps in the transformation process. 


step 1. 
At (1) the output from the procedure is pres2nted: 
{x} 


tep 2. 
At (2) the "£" Poop 15 eur ees agian dene 


{f (x) } 
step 3. 
At (3) 2% 1S substituted topyal Ian tances) eee 
£( {2x}) 
intended to, be useful, axcept in how it illustrates the 


transformation process. 
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® 
——— a a a ee EE ee ee ee ee ee eee ee ee SS a 


de a ey ne ee | 





(2) 


(4) 


city cay aap as a i eR eet) mc ce OI) eee 


eine "amantadine ee aah mS eg i iia. 


P 


Figure 4.6 Flow Chart of "highest" 


Step 4. 
At (4) the program branches to either (3) or (1): 
fif x < 50 then} 
EUG) 
{else} 
X 


Note that 12t ais here that the function "f" is defined. 


We therefore will take advantage of the oroperty of 
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referential transparency and only caney Me (x) forward as we 


proceed in the transformation process. 


step 3- 
At (5) the program branches Lom(teon (1): 
fli x > 30" then} 
x 
else 
! ars 
This gives us the functional definition of aighest em 
we include the definition of "£" from step 19. The complete 


definition cf highest is contained in Figure 4./. 


en a 

| | 

highest (xX) | 

| if x > 20) then | 

X 

else 

£ (x) | 

| where | 

| f(x) =a | 
me x < 50 then 

| £ (2x) | 

else | 

| | 

| 

| | 

enti en cota a ee a 


Figure 4.7 A Functional Program with Looping 


Note that the looping structure of the imperative programma 


captured in the recursive nature of the function "ff". 


D. TRANSFORMING "COMPLICATED" STRUCTURES 


The Henderson transformation process does not take into 
account variables which are part of an array or record 
Structure. The method of transformation is the same, but it 
1S not immediately apparent how to access thes2 variables. 


In the next saction of the paper, I present the translation 
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of a Shell sort from an imperative language (Pascal) toa 
minctiOndi = preagramming language. I use two Lunstions, sub, 
and update, MematcnleVec .4CGCess Of Waurays, ani to update 
elements therein. I handle records by dealing with them as 
Mmests Of JlStS,) And using Stub to access Ehem. The defini- 


Prons Of Sub, ama update are found in Figure 4.1). 


E- TRANSFORMATION OF SHELL SORT 


AS a more complicated example of tne Henderson transfor- 
Mation process, I will present the algoritnm Saell sort in 
imperative form, and then give tne step-by-step translation 
into a functional form. I[ will also present a2ore eleyant 
functicnal representations of the Shellsort, and make some 
comparisons. Reference {30] provides an excellent discus- 
sion of the Shell sort, although a thorough undecstanding of 
Hewett wOrkS 1S hot necessary in order to follos the trans- 
monMation process. 

The imperative form of the Shell sort is taken fron 
Tenenbaum and Augenstein's text on data Structures 


Meet. 31j. Figure 4.8 shows this progran. 
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re ee 


= 22202 NN Eee 
const numelts = 100; 
type area y Ey e = array({ losoUme mes mer wnt cgoce 
aptr = 1\..numelts 
incarcray = 
record 


numine? to. nu meme: 
dee accray(1..numelts) OF apes 
= 0 
var xX: arcaytype; 
Ne eapee 
procedure shell (var Xi: aALEayt y pewamaptrjine:itacartragge 
var j, Sere ne i 
gE one k: integer; 
found: Losilear 
begin (*pcocedure "shell *) 
for incr <= FF ferinc. numimie 
do begio . 
Spah := Ince trerr nes (an cme. Span 1s ths sae 
*OL the 1PeCr= emir. 


ee 2 {= Ssoatteto 7 
ejin 
(#ing ert element x({j) into its proper®) 
= POSICIOM WIthin geese oueerre *) 
32 Fidhin 
fc Ses = fa lees ae 
while (k <= I and (not found) 
Go. lt y <_ xX (k) 
then begin 
m(k+ Spal) 2s (kk): 
k := k-Spa 
end 


else found := true; 
x {k+s V0) = 

end (*2OEr.-.00°o beyin*) 
end (*for...do begin 
end (*procedure shell* 


Dniester PS teats PE seers gages SUD —ayRts Giengeepah penis GA are cea CA ste, Men Geneeagas ea ape a i ee ee diaries Metetnee cemesding aptamer A Saati a OE eaten, amen tell ROE teeny semen Gens 


Gb. oo Aa |} pee: Gree a 


Figure 4.8 Shell Sort in Imperative Form 


The first step in the transformation process is to nodel 
the imperative program in aflow diagram. This iS shown in 
Figune 2.9. 

Because of the array and record structures used in the 
imperative algorithm, I will use the sub and ipdate fune= 


tions. In figure 4.10 these are defined, and the sters of 


the transformation process are labeled. 


=) { 





Figure 4.9 


Sheil Sort 


Sea al 


a 
F 
found ;= true 


wk 35 k = span 





incr se Incr + 1 


Flow Diagram of Shell Sort 


a 


; 


eee ae ee ee ee ee ee ee ee ee ee ee eee ee eee eee eee ee eee eee ee eee eee 


{tf f=) tnen 
x cons(resta) 
else 
first(A) cons(update(rest(A), f-1, x)) 


upaste(A,1,x)= 


tf f#1 tnen 
first¢(l) 
else 
saed suo(rest(L). 1-1) 


suo(L,!)= 





y :« sun(x, f) 





Sy 
(16) 
false 
iid (4) 
founda := false (6) 
(14) 








Iiner se incr + 1 


2 a 
peSieus KeSbans 
y 


(3) 
(22) 
false 
s= true 
(1) 


(2) 








f ound 








xX 3# 
pdate(x,k+*span, 
sud(x,k)) 





k r= kK - span 





ee 


i — a an ie ime ae a a I a 
ee ae cy i ies ii a i MS —s 


| 


es eS a SS ee ee 


Figure 4.10 Shell Sort with "sub" and "update" 


Using the same method that I have outlineji in previous 
Soci LoOns 2 UOWMPLeSent th="transrtormation of th= Shell sort 


iieo e@ EuUNctional language: 


step di. 
At (1) the sorted array is output: 
{x} 


step 2. | | | 
em theme teeeOOD 1S Cut, resulting in; 


(Lites PaAn, i, oan, COUNU, xX, Nn, 
inc) } 


(Ss) tniewemms a Dranch tomelthss (1) on a2) : 


foewermet = (sub(inc,1)) then} 
emer, Spada, J, ¥, , Lound, 
ort Te) 


4 
ee eo) iicrtiers Substituted for incr: 


Taney Soe oc) >, then 
incrtl Spal, oye, LOUNA,; 
a Th, incf 


oR Ohh IO 
— 
Maw «i+ 


re (Setuomuge  1OOp 25 Cut, resulting in: 


(cacti wymsPan, a,eey, kK, =ound, x, 
Nya) 


step 


6. 
At (6) there is a branch to either (4) or (5): 


Piet jen Een } 
Sil hes eae ee 2 Un aes , 


Oe alee: 
{else} 
mine reies (Sub(inc,1)) then 
Peter SOI, ja %s Kk, Lound, x, 
Wepre) 
else 


x 


54 


ep }. 
At (7) Jj+#l iS SUBSE EUG ed fora 


Lie {je dies eens 
GuGune is i) +0, VY, OMe ound, 


aie sh eeles 
else 
Lf inert l’ Ss isub (ne: an then . 
£L{L NCL Ve, Seam, ae Vie O UN Cy 
heen) 
else 


Li girls no tren 
g(iner , Span, J+1, Yak, foam 
f(update (x, k+s pan, ae ae inc) 
se 


Li Av Ger es ne Eee 
Peer Is hat, Erouna, 
{update (x, eee Lae DepeetuTe)} 


1s 
Heda iz, ktspa hy) 


{fh (nen, Span, jy, Ke 2 Oumar 
x7 ale, inc){ 


AE (1 10) k-Span is substituted for k; 


h(insr, span, j,°¥ 78s SUt eee cme 
ine) 


Key Ty 


he (aenea - aa ae 
apda ten ne Ke Spee TDS 
Ni, Lic) 
step 12. 
At (12) toue is substituted for found (from (9)) 
h(incl, Spangej, v eee eee 
step 13. 


At (13) there is a branch to either (11) or (12) 


flay << S ubeice kK), oe) 

H(laeri, stan ¥, K=Span,. tound, 
update (x, boesan’ sub (x, ky), ee 
Lie 

{else} 

h (incr, Span, J, 7 eee Ue 
LD e) 


aD 


jee 
AE (9) the “h" loop 1S Cute pesmeci oe ea 


a7 


Anis) 


8 
At (8) update(x, kK+Span, yy) 1S substituted for x: 


At (11) update(x, ktspan, sub(x,k)) is substituted 


fOr 


Aten ememts dad branch to eltheret)3) or (8): 


eG. es a and (found = false) then} 
ove cmo tO (x. K)) then 
hiiwer, Span Je Ve SpA ound, 
upda C(x tSPadepeesul (x, K)), a, 


inc) 
else 
hi (aie: S Dan eat, EVeeek, Lolo, ee Gy Ls) 
{else} 


itt 82 then — 
Giietiews.,) Span tees X » 1) } pee 
i felx, ; 


tf 
Found, upda MeSwat Sum (x, 1) ti, 
Dye ne ) 
else. 
ii eiier* 1S (SUD {imert)) then 
iewGet 1a, Sian, Peale ¥, K, mound, 
A iNgcsee (ky eKtS Dal,ey), O28, Lnc) 
else 


Mod@ace(x, Ktspan, 7) 


Meee that if PS this step that the function "h" is defined. 
We therefore will take advantage of the property of referen- 
meal transpareneveand Carey hfincr, Sdan, J, Y, *, xcound, x, 


h, inc) with us as we proceed in the transformation process. 


At (15) false 1s substituted for found: 


Pino Dail, VY, K, {Lalse}, x, N,.Lnc) 


step 16. 
At (16) j-span is substituted for k: 


Pi@Gice=amsDan sl, 7, 9 ()j> span}, Ldise, xX, A, inc} 


Deer te(t7) sub(x,j) is substituted for y: 


Re je {sub(x,j)}. j-span, false, 


Note that it is this step that the function "g"" is defined. 
We therefore will take advantage of the property of referen- 
mee tCranSpabenGy dMamearlry G{1NGEy;eSpan, je y, <, found, x, 


Meeanc) with uS aS we proceed in the transformation process. 
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At (18) Spantl 1S Subst2tuted vom 


G (ine r, ae {spantl}, You tcuna, 
, in 


Seep ee _ 
At (19) sub (suo (ine, Z), anckE) Veeeteotitutel £or saan 
ic Er sub (sub{inc,Z), oes 
WU sab {sub (inc, 2), ner} | ue PU ie 
Ound , XX, tenes) 


Note that it tS this step that the function “£" is deaimem 
we therefore will take advantage of the property o£ referen- 
tial transparency and carry f(incr;e Span, 3g, ves, LOUneC eee 


n, inc) with uS as we proceed in the transformation process. 


step 20. 
At .(20) Teas Substitute d or Amecs 


L(1, Span, %, VY, kK; LOuUDGg ewe, ie) 


Recall that the function f is defined in step 19, the func- 
tion g is defined in step 17, and the function kf is defined 
in step 14. Figure 4.11 is the functional program for Shel 


soct. 


F. ELEGANT SOLUTIONS 


An elegant solution iS a program which is developed from 
the outset from a functional viewpoint, i.e. it does mex 
transform an existing algorithm. The advantage of uSing an 
elegant solution is that it provides you with a sustom solu- 
tion to the problen, lee. ait will be designed for the 
specific purpose for which it is intended. That could lea 
to a limitation in flexibility, just as a custom wet suit is 
rarely useful to any diver except the one for whom it was 


Specifically intended. But if the designer of the program 


Be) 


He , ae 3) Was peo, X, 0, LC) = 
Spal, ay sie Ouna jk h, eS) 


“-—, ry 
ma Ole 
ba) Fi 
Sees anes eine es ee eee cee 


Wiebe E{ECL, Span, Je Vou Ky, LOUNG, 


ae 0 

Cignee re, sub (Sub (inc, LAME Pag ese) ar 
Stpmosub(ine, 2) ,20Gr jitelgesy, Ke 
Bound, X, Nn, inc) 


andec (1 nCil,. Spam, Maree), ee, -Ound, 
Xp. hyo slae) = 

Deeiiee, Shan, Je Saoix, J) ie opanh,) Lalse, 
Koei, LIC) 


| 
| 
| 
| 
| 
dione G, Soin, weer Kec Oound, 
Xe Np a2auc) = | 
(K 2 1) and (Found = false) then 
‘Fe y < sub(x,k) then 7 
MeLtck, span Je ea > Dole 2 Ol bal, | 
up e(x, Ktspan, subd (x,¢)), 1, | 

hs 
else | 
TmelNICr , woodhymeyi, VY, K, true, X, nh, inc) 
else | 
ee = Weene n ; ee F : 

Pier , Span + Subetcy a), Ph Gonsqsle 
: ede. eee Bee Vie | 
te pee) : 
alse 


Vi anert? s Ses aie Wi then 
P@merr i, Span, ie aes found, 
Be en Ta paln, fale Mie ne) 


(ce Paice (GS MOG MR GR ee MM A i Me Ae A a TNS oe GEER Lee iaiiach emiaeienciy Si Simm aa! 


i 


els 
ipdate(x, k* Span, y) 


Figure 4.11 The "Mechanical" Solution 


keeps a Eroad view of the problem, the result should be easy 
to read and understand. It should be much easiect to improve 
than would be an imperative progran, and because of ali of 
this, it should be easy to modify as the denands on it 
ebange. 


In reference [26], Burge develops an elegant solution 


for the Shell sort. First he "streamlines" the algoritha, 
erading it sf what he identifies as (iwWee sbnetticien- 
cles. 
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Then he develops a functional program for that algor ieee 


(Ref. 26: pe222]. Figure 4.12 coneamne eis  SOlyrao a 


SOrt i 4 

where rec SOrt a pen 
Sorts aap 
Solna ae 
interchange a p 


ANGwsents aa P = 
Li 3p > n 
then exi 
else sort a (3p) 


sSort(a + é| 
a Gees + Bt 8h) 
And SOr eZzaa pp — 


if'a + Pou Po 6 
then exl 


ee ee ei Fe ne eee Le tier oy ee ee | 


iia Sled Gini OR cacis imine RRR Cian Tie i fg ES ES Sie HS ER Gy ED EE aD 


SOLtm(a ty 5) (27) 
and sortm ap= 
Sore 2 dD 

INGerecnamge a p 
and interchange a p = intch 0 | 
where rec intch {q) = 
Lt aot ee een i 
eise if Al 1< af | 

else 1 a + a + Mie 
then Ala ? Glasses Nea + 3 sae a { 
ce een!) | 
else intchi(qg + ay | 
= | 
—— cae coos aes a a ed Se car ee ee aoe a 


Figure 4.12 Phe “tlegant' sseotutiren 


Burge uSes some notation which jieserve discission. de 
uses the notation rec as a “#lag" to indicate thit the fea. 
tion being defined is recursive. When rec appears ina defi- 
nition, both the left-hand side and the right-hand side of 
the definition contain the identifier. Burge calls this type 


of function circular (Refs §26: peu 


*On p.263 of reference [26], Burge States, "Most conta. 
methods [which] have been. cupeesoee here ina f£unctienmem 
notation can be found in he extensive literature on 
eS It seems that one should be able to infer fron 
that statement that the sorting programs he d3velops are 
functional. This is not necessarily the case, which isa 
point I develop in the ensuing text. 
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The symbol ":=:" deserves special attentio1, since it 
appears to have all the earmarks of an assignment statement, 
and also appears to be at the heart of Burge's program. The 
"te=3" exchanges two elements of an array, 1.e., A[Lij :=: 
Afj |] exchanges the ith and jth elements of array A. Thus, 
given an array, A, of the form: 

Gens 5 nis Aa ee 
wnere a=1, p=2, and yj=1, 
Afat+gq] :=: Afatptq] would result in 
CG CeO ea. 
This can be sonceptualized in at least two ways. One way 
would be to use a temporary variable and to use a Series of 


asSignment statements, such as listed in Figure 4.13. 


| ee ee ae | 


| 
| : 
Se 


Figure 4.13 Imperative Definition ":=:" 


@eis clearly 1S not a functional approach and will cause us 
to lose the properties of referential transpareacy and eval- 
uation order independence in our program. 

We could aiso interpret the ";=:;! as two successive 
applications of the update function.!5 This would result in 


code oi the forn: 


update { [update ree a+qd Suomi etans) |, 
C Z ae hore Sea P+g]3) J 


The effect of this code is listed in Figure 4.14. 


1SSee Figure 4.10 for the definitions of sub and update. 
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cece SND USS Sh ES ET SS A A 


2. Return an acray A* which is the same as arcay A 
except that the Coe th element is the same as the 


| (atp+g)th element orf array A. 


4 
| 
1. Take as input array A. | 
| 
| 
3. Return an array A" which is the same as arcay A’ | 
except that the (atp+taq)th element is the same as the 
aoa) elenent of array A. 





Figure 4.14 How the Functional "s=:" Works 


This code is a little dirficuit to read, so now thane 
understand itsS meaning, we will make it a Separate function, 
exchange, which "swaps" the (atgq)th and the (atptq)th 
elements of array A. Figure 4.15 contains the dafinition of 


exchange. 


(a se Se a See em Se me oe eee eee eee 


Excnange (A,a, :dh = 
Upaatets i ate (A, tS eae eee oo 
L 


pt 
p+q ], subs A,ata 


iy 


a 


=~ on 


| ny ne | 


Figure 4915 Functional Definition of ":s=:*" 


From a functional point of view, the meaning Of "2 =: 
cleared up now, but there are still some questions akout 
Burge's "functional representation" of Shell sort. The code 

then exit 
appears in the program three times. This code is not seman- 
tically acceptable in functional programming! What we 
should be doing at these points in the program is returning 


the sorted array. The code for this wotlid not be dititac wm 
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BomcGecvelou;  ommout 1t leads us to the discovery of (froma 
functional programming viewpoint) another difficulty with 
Purge" S programe The array to be Socted (presumably A), is 
not listed as one of the input parameters of the program. It 
probably is treated as a global variable, Witenemor COUrSse 
leaves the code unable to stand correct on its own. 

The Last gapticulty with Eurge's elegant solution is the 
way he ilists statements sequentially in the defirition of 


res sort. The program segnent 


sort3 a p 

SOptZ aa 

interchange a p 
mMeuid have to be changed to a functional form. This again 
points out the necessity to pass A to the funzstion as an 
input farametsr. The three functions couid then be apriied 
miethe form 


antler emamere {SOrtZ) SOrt3 (A,d,p) ,a,P ],a,P} - 


t+ 


Be Course, the functions sort3, sort2, and intercha al 


SOC nye 
must have an array included as an input/output parameter of 
their respective definitions. 

All of this leads us to the unsettling 31d somewhat 
Seaqrtling tealizadtion that Burge's elegant solution is 
recursive, easy to understand, but not functional! As I hope 
you will agre2 by my discussion, femwouldenot be ~ditficult 
to develop a purely functional program from Birge's solu- 
meen, but as it stands, it is not suitable for parallel - 
processing. 

This leads me toa discussion 9 the dangers of using 


“Dseudo~functional" programs. 


16He could define a function exit which ceturns’ the 
sorted array. 
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Ge. POTENTIALS ET IFTALES 


When Locking for an “alegant"™ Solution, one can COnSiaEE 
with a programmer who is expert in the art of functional 
programming, or consult the literature for a program which 
has already been developed. In the former case, it i 
important to ensure that the programmer knowS that the 
program is to be used on a multiprocessor, and hence must be 
functionally pure. In the case of a literature search, one 
must be a bit more careful. 

Each program which is taken “ofr the shelf" must be 
scrutinized to ensure that it doesn't have any asSignnent 
Statements (explicit or hidden). It mist have no sequential 
segments, ani must have all "variables" accounted for in 
parameters. Many "functional" programs found in the litera- 
ture will appear to be functionally pure. Nevertheiess, it 
is important to go through the code symbol by symbol to 
ensure that the properties of referential transparency and 
independence of evaluation order independence are being 
preserved. Note that the code cite any =fuwnetmon thatum 
called, but not explicitly defined, must also be scrutingzes 
so that we can be certain that the function is based on pure 
expressions. 

One must also be careful about using languages which are 
sometimes thought cf as "applicative" within compu Gas 
science, but which are far from "pure" in the functional 
sense. Perhaps the best example of this 1s LISP. There are 
versions of LISP which are suitable for concurrent 
processing, such as concurrent ISP eekeLt. S2ie The limita- 
tions of this version of LISP are the same as the limita- 
tions of concurrent versions of other lanjyuages with 
imperative features. Mechanisms are created ts ailow the 
programmer to label critical sections, so that side effects 


will not appear during the concurrent processing. Note that 
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the burden is once again placed on tne programner, making 
the process prone to error and diminishing the chances that 
SONCUETONnCyY wlll be Maximizeds Figgre 4.16 is 1 LISP solu- 
prope to the breadth first search [Ref. 27: p. 146]. 


1 
| 
| 
| 
| 
| 


(DEFUN BREADT 
(PROG 


mH 


Mminmmomanrn 
co a ee ad 


po 


ae coe ee ee se ers ce cc cc se ee ee ee ee ee 


Figure 4.16 Breadth First Search in LISP 


Note that every SETQO is equivalent to an assignaent 
Peactement. So although LISP has the potential ts be used as 
a purely functional language, 1t 1S rarely used in that 
moet tt looKSuaunctional, but 1S really no tore functional 
Pram ak ALGOL GE Pascal progran. 


The bottom line when it comes to using functionai 


programs to enhance concurrent processing is: be certain 
that the proyram that you are calling "Zunctisiai" can be 
reduced to pure expressions. 
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A. OVERVIEW 


The assignment statement is the von Neumann bottleneck 
of programming languages. When describing lanjyuages which 
are based on pure expressions, Friedman and Wise point out 
that one of their most notable features is that they do not 
have "destructive" assignment statements, and arte therefore 
free of side effects [Ref. 33]. This is the way in whieh 
referential transparency and independence of evaluation 
order are achieved. Cnce these attributes are 9resent in a 
programming language, its expressive power (in terms of its 
ability ~ Gombe processei in parallel) is no longer 
constrained. Many languages have "concurrent versions" 
which allow them to be processed on parallei tmachines. 
Unfortunately, these languages put the burden on the 
programmer tod identify the “epee sections. This 
increases the chances of programming error. Such errors 
would be manifested in side effects, and could go undetected 
Unde do potentially disastrous effects acre felt. 
Functional languages do not have critical sections, and 
hence can take advantage of the hundreds or even thousands 
of processors that are becsoming available because of VLSI 


technology. 


B. MECHANICAL SOLUTIONS 


- 


When technological breakthroughs are achieved in 
computer science, it seems that there is a concern among 
those who alrsady have large investments that their existing 
systems will become obsolete, and thus practically worthless 


overnight. Evan in cases where hardware costs ar2 reasonable 
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emough tO be eitelcine, wthemcosts of adapting existing» soft- 
ware to the new machinery 1s freguently staggering, if not 
cost prohibitive, The mechanical means of converting imfpera- 
wivTco PECQGLausomeautO LUNCtLONalL Ones 1S very attractive in 
errs light. It 1S a Simple process which produces programs 
which nave all the properties of pure expressions. This 
means that all variable/value bindings are established as 
parameter/fargument bindings in function linkages, and are 
therefore not subject to change during their lifetime. This 
presents an obvious opportunity for parallelism since subex- 
pressions are independent of one anotner and tierefrore can 
be evaluated in any order, or simultaneously [Ref. 33]. 

In addition to creating code which can be processed ona 
parallel machine, the mechanical transformation iaiso results 
in code which is easier t9 understand than imperative code. 
This is Lecause functions are GesSigned to be cefinecd in 
toms Of Other £unctions. This leads to a "layescing"™ effect 
which removes the programmer from much of th2 unnecessary 
detail of the progran. 

A functional program may be viewed as a set df mathenat- 
ical equations which specify the solution [Ref. 34]. Even 
the "mechanically producei" functional program will be nore 
Suited to a proof of correctness. If an imperative projran 
as at all complicated, it will be extremely iifficulty to 
fee 2c COLboeteeme  hUS this “by-product” of the transforna- 


tion process is a very useful one. 


C. ELEGANT SOLUTIONS 


Despite the attractiveness of the mechanical transforma- 
tion process, I am not recommending that it be used unless 
there is already a program in use which meets or exceeds the 
expectations being fplaced on it. In other cases, a new 


program shouli be designed, and a functional approach should 
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be used throughout its lize cycle. In this way, programs can 
be tailored for the exact specifications for which they are 
intended, although the designers should take precautions to 
ensure that they can be extended to neet future ceguiremerts 
that arise during their life cycles. 

When elegant solutions are used, Special zare aust be 
taken to scrutinize the code to ensure that it can ie 
reduced to pure expressions. One must be especiaily careful 
when using algorithms from the literature that are tagged 
"functional." There are many languajyes which adpear to Le 
functional which have "hidien" assignment statenents. the 
presence of these will adulterate the program, and render it 
unsuitable for parallel processing as we have ceen 


discussing it. 


Dae ar per Ney 


Recursive functions usually result inan exponential 
growth in parallelism [Ref. 35]. Functional notation Taeee 
rally lends itself to recursive functions, so there will 
likely be a great many subexpressions which can de evaluated 
Simultaneously. On a uniprocessor, a functional D)royram will 
run much more slowly, because of all the procedure calls. 
Tradz,tienally, proponents of functional programming have 
been willing to trade inefficiencies in their programs for 
greater understandability and provability. On multiproces= 
socs, the inefficiencies caused by the proceduce calls are 
not Significant compared to the speed gained py parallel 
processing. The result is that, ina multiprocessing envi- 
ronment, functional programs are not only more understand- 
able, but they run faster, too. Since functional languages 
exploit the power of multiprocessors, we can enjoy the best 
of both worlds! 
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E. A SURPRISING OUTCOME 


When I started to learn the mechanical transformation 
process, I was convinced that the resulting coie would be so 
complicated that it would be impossible for people to under- 
stand. Nevertheless, I reasoned that Since it would still 
have all the properties of pure expressions, the code would 
Fe quite suitable for processing on a parallel machine. fhe 
Seiya bawcoack,s. supposed, would be that it would be dit<ri- 
it tO Malntian. 

The £irst time I converted the Pascal version orf Sheli 
PwetmintO ad cmetlonal notation, I was met With code that 
was indeed obscure. The reason 1S tnat I tailed to take 
advantaye of the property of referential transparency waen 
Getining a fInetion ina loop.1’ When the substitution 15 
made, this forces the program to a higher. level of abstrac- 
tion, and tremendously increases the understandability of 
Bie program. Thus when a comparison is made between the 
mechanical solution Figure 4.11] and the elezjant solution 
{Figure 4.12], there isn't a great deal of difference in 
their readability. This makes the mechanical sdlution even 


more attractive. 


me GOIHER ISSUES 


The developers of VAL concluded that the most serious 
weakness of their language was an omission of general input/ 
Steput facilities fF Ref. 29: p.j67}. Such a daficiency is 
common amorg functional programming languages. AS is the 
case of VAL, the notation I. have been discussing really only 
permits the most primitive I/O, namely, batch I/). No I/O is 


actually done within the functional programs themselves. 


ee fe Stevomaugmety, and 19 in TRANSFORMATLON OF 
Loe 


There are technigues for extending functional notation to 
include I/0, put they are beyond the scope of this paper. 
Finally, note that I have made mS reterence to a garbage 
collection mechanism. In functional programs, structures are 
not overwritten. Recall that the update function creates a 
new array with the changed element. The "old" array 1S ie 
overwritten. This process takes a great deal of nemory. Thus 
a good garbage collector is a necessity. It must detect when 
structures are no longer going to be used in the progran, 
and reclaim the memory they were using. Such mechanisms are 
available tolay, and thus the problem of making memory 
available for functional programs does not pose great 


die faculty. 


G. IN A NUTSHELL 


As long as the assignment statement iS present in 
programming languages, we will not be able to tace advantage 
of the potential processing power of the new machines that 
are being developed. Functional programming languages do not 
use asSSignments statements, and tnus have the properties o£ 
referential transparency and independence of evaluation 
order. In addition, functional programs are free from side 
erfects, lend themselves to algebraic manipulation, and are 
much easier tO prove correct than are imperative programs. 

There are Many imperative programs which have added 
features to enhance concurrent processing, throujyh the iden- 
tification of critical secuilon.- This places an additional 
burden on the programmer, and increases the licelihood for 
eCrrors in the programs. The concurrency mechanism of FPIs is 
built into the language, and thus the need for tne 
programmer to identify critical sections is eliminated. 

Functional programming lanjuages hkave long been 


applauded for their understandability. The ability of FPLs 


Oy 


to be processed in parallel has been known for some time, 
Dut Only wttaewtene advent sf VLSI technology, ani the devel- 
opment of machines containing a larje number o£ processors 
is the usefulness of this property really becoming apparent. 
bunctLLOnal PEOgGranming languages havemethe potential to 
completely harness the power of this new generation of 
machine. 

Imperativ2 programs can be mechanically transformed into 
mpnetional programs. ie CO thiomecibiere GOnecuLeckKiy ani 
inexpensively, it is an attractive nethod for taose whe are 
considering investing ina parallel processing environment, 
but already aave a-‘large amount of Software written in an 


imperative language. 
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